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DETAILED ACTION 

1 . This action is responsive to amendment filed 06/09/05. 

2. Claims 1-11,1 5-24, 28-42 are pending in the application. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1 ) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

3. Claims 1-4 and 15-18, 41 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Jain et al. (5,729,471 ). 

Claim 1, Jain, in disclosing a view selector, also discloses a time-series data 
processing device, comprising: image-pick up means for picking up a specific object 
(cameras 10a, 10b, etc., FIG.1); data processing means for generating a data list 
indicating, in time series, a temporal transition of a position and a state of said object 
picked up by said image-pick up means, with respect to a time (environmental model 
builder 12, FIG.1); animating means for animating said transition of said position and 
said state of said object in accordance with said data list (viewer 14, F1G.1); and 
display means for displaying at least one of said data list generated by said data 
processing means and said image animated by said animating means (display 18, 
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FIG.1); wherein the display means is operable to display the data list (camera list or 
player's list) and the animated image (players); (fig. 4 is a pictorial representation of a 
video display ). 

Claims 2 and 16, Jain discloses said data processing means configured to 
display synchronously on said display means each corresponding image by linking an 
image of said object, which is picked up by said image-pick up means, in accordance 
with said data list generated, when said display means display said image of said object 
animated by animating means (co1.16, lines 34-44). 

Claims 3 and 17, Jain discloses said data processing means configured to 
perform at least one kind of data analysis, by linking an image animated by said 
animating means, in accordance with said data list generated (col. 18, lines 24-33, 
especially lines 29-33: data processing means selects "best" camera view). 

Claims 4 and 18, Jain discloses said specific object comprising a tool used by 
players in a sports game (football; col. 14, lines 29-36). 

Claim 15 is essentially the same as claim 1 except claim 1 is an apparatus claim 
and an apparatus and claim 15 is a method claim. However, Jain also anticipates claim 
15 because it is inherent that an apparatus facilitates the implementation of a method. 
4. Claims 6-7, 20-24, 36 and 38-39 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Katayama (5,769,713). 

Claim 6, Katayama, in disclosing a data processing apparatus for a baseball 
game, also discloses, with respect to claim 6, data processing means for generating an 
image data by image-picking up an image of a sports game (through a video camera; 
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col. 6, lines 1-3), for processing said image data generated in accordance with a 
predetermined format (video, col. 6, lines 1-3); and for storing said data processed in 
said predetermined format (videocassette; col. 6, lines 1-3); interface means connected 
to said data processing means comprising an instruction entering means for entering a 
plurality of instructions (menu screen 1 , FIG.3, and menu screen 1 1 , FIG.1 1 ), said 
interface means also receives said processed data in said predetermined format from 
the data processing means, converts the processed data into a predetermined form in 
accordance with an entered instruction, (statistics; see, for example, col. 6, lines 12-20); 
and outputs said converted data in accordance with said entered instruction; (FIG.1 6 
the output of clicking on the score table L icon in FIG.1 1 ); and image displaying means 
connected to said interface means for displaying on a screen said outputted data from 
said interface means (monitor display A, FIG.1 ) wherein said interface means is 
operable to convert said inputted data into each of a chart, a numerical list (the object 
labeled "batting order" in FIG. 22 is both a chart and a numerical list, and the chart/list is 
produced by the instruction which executes when the R key is pressed (see col. 8, lines 
29-31 ), an image (produced by the instruction which executes when the user clicks on 
M and L; col. 6, lines 40-44) and a video (the instruction that produces, for example, 
FIG. 12; see also col. 4, lines 50-53). 

Claims 7, 21 and 41, Katayama discloses said interface means configured to 
enable said image displaying means to display a play list or a graph that is indicative of 
a desired analytical result in response to a kind of said instruction (FIG. 22, which 
concerns meetings between a certain batter and a certain pitcher). 
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Claim 20 is essentially the same as claim 6 except that claim 6 is an apparatus 
claim and claim 20 is a method claim. However, claim 20 is also rejected because it is 
at least obvious that an apparatus facilitates the implementation of a method. 

Claim 22, Katayama discloses all claim limitations through "displaying said 
converted data" (see claim 6), and also these limitations: wherein said step of 
converting said data processed in said predetermined format (video; col. 6, lines 1-3) 
into said predetermined form in accordance with said instruction (statistics; e. g; col. 6, 
lines 12-20) comprises entering at least one related item with respect to a sports game 
subject to an analysis, which is utilized commonly in said plurality of different kinds of 
analyses by entering a common instruction (selecting a player from the score table in 
order to view pitching form of opposing pitcher; col. 6, lines 40-49); wherein the data 
processed in the predetermined format is converted into numeric data for the plurality of 
different kinds of analysis (a numerical indicator of 0 to 9 for inputting a ball speed 
thrown by pitcher are provided; col. 4, lines 66-67), and wherein based on a kind of 
analysis, the converted data is displayed in a form of numeric list (col. 5, lines 49-57), a 
chart, a graph (col. 7, lines 10-22; fig. 17), an image, and a video (col. 6, lines 45-49). 

Claim 23, Katayama discloses said related item including at least one of a 
player, a team, weather, a stadium of a game, a date of a game, a starting time of a 
game, and a number of spectators of a game (player; col. 6, lines 40-40). 

Claim 24, Katayama discloses said step of converting said data processed in 
said predetermined format into said predetermined form in accordance with said 
instruction comprises selecting an analysis of data or an analysis of formation regarding 
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a sports game subject to an analysis by main instruction entering (analysis of pitching 
form of opposing pitcher (col. 6, lines 40-49). 

Claim 36, Katayama discloses said interface means further comprising a 
function of linking one analysis to other analysis in accordance with said play list 
(meetings between opposing pitcher and batter are the subject of analyses in at least 
FIG.22 (col. 8, lines .29-33), FIG. 21 (col. 8, lines 13-15), and FIG. 19 (col. 7, lines 56- 
61). 

Claim 38, Katayama discloses generating image data by imaging a sports game 
(through a video camera; col .6, 11.1-3), for processing said generated image data in 
accordance with a predetermined format (video, col. 6, lines 1-3); storing said data 
processed in said predetermined format (videocassette; col. 6, lines 1-3); entering a 
plurality of instructions (menu screen 1, FIG. 3, and menu screen 11, FIG. 11), 
converting said processed data into a predetermined form in accordance with said 
entered instructions (statistics; see, for example, col. 6, lines12-20); displaying said 
converted data (FIG. 1 6-the output of clicking on the score table L icon in FIG.1 1 ); 
displaying a play list or a graph that is indicative of a desired analytical result in 
response to a kind of said instruction (FIG. 22, which concerns meetings between a 
certain batter and a certain pitcher); displaying all plays of an opponent terms at said 
sports game as a list in accordance with said play list, retrieving a desirable play seen at 
said sports game by designating an optional item of said play list (FIG.1 6 displays all 
plays, and col. 6, lines 24-48 explains how a desirable play is retrieved); wherein the 
converting is operable to convert the processed data into the predetermined form of a 
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plurality of predetermined forms comprising a chart a numerical list (the object labeled 
"batting order" in FIG. 22 is both a chart and a numerical list, and the chart/list is 
produced by the instruction which executes when the R key is pressed (see col. 8, lines 
29-31 ); an image (produced by the instruction which executes when the user clicks on 
M and L; col. 6, lines 40-44) and a video (the instruction that produces, for example, 
FIG. 12; see also col. 4, lines 50-53), a graph, a chart, a list, a diagram (fig. 17). 

Claim 39, Katayama discloses linking one analysis to other analysis in 
accordance with said play list (meetings between opposing pitcher and batter are the 
subject of analyses in at least FIG.22 (col. 8, lines 29-33), FIG.21 (col. 8, lines 13-15), 
and FIG 19 (col. 7, lines 56-61)). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 5, 19, 28 and 31-33 are rejected under 35 U.S.C. 103(a) as being 
unpatentable by Jain. 

Claims 5 and 19, Jain does not specifically disclose said sports game as 



Application/Control Number: 09/919,989 Page 8 

Art Unit: 2671 

soccer, and said tool as a soccer ball. However, there is no appreciable distinction 
between soccer and football with respect to this invention. Football was only an 
example of many possible sports applications to which the Jain invention can apply. 
This invention can be applied to any sport that is highly structured from both a database 
and computer vision perspective (see col. 18, line 66 to col. 19, line 3). Both soccer and 
football feature, for example, hash marks to indicate a set distance from the side border, 
or sidelines, of the field (col .22, 1 1 .18-19). Therefore, it would have been obvious for 
Jain to have disclosed soccer and a soccer ball in addition to the game of football and a 
football. 

6. Claims 28, 29 and 31 -33 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable by Jain in view of Katayama. 

Claims 28 and 29 Jain discloses a method of processing data in time-series 
comprising imaging a specific object (col. 16, line 17 and 32-34); generating a data list, 
said data list comprising position coordinates of said object and flags indicating a state 
of said object at a plurality of points in time (col. 22, lines 27-37 produces a data list 
comprising position coordinates of said object at one point in time; however, it is 
obvious that inquiring as to the position coordinates of objects at another point in time 
(for example, by capturing the image at another time) will produce "flags indicating a 
state of said object at a plurality of points in time"); analyzing said data list based on 
instruction from a user to determine desired output (in col .22, 1 .62 to col .23, 1 .56, 
analysis occurs of 2D locations of a player to determine 3D location. Col. 21 , lines 26-38 
disclose that this occurs due to the use of a viewer's 3D cursor); and displaying said 
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desired output (col. 21 , lines 41-46). Jain does not teach desired output in a desired 
format chosen from a plurality of formats which comprises a chart, a graph, a numeric 
list, and a video; however, Katayama teaches this limitation: a numerical indicator of 0 
to 9 or a flag indicating a state of the object or to determine speed of the object (the 
speed of a ball; col. 2, lines 45-47; col. 4, lines 66-67), a chart, a graph (col. 7, lines 10- 
22; fig. 17), a video (col. 6, lines 45-49). It would have been obvious to one of ordinary 
skill in the art at the time the invention was made to incorporate the desired output 
format taught by Katayama into the dynamic scene of Jain, because it would provide a 
method for displaying the collected data in the form of characters, diagrams, stills or 
dynamic pictures on a computer display (col. 1, lines 8-10). 

Claim 31, Jain discloses said object as a player and said state of said object 
comprises at least one of a play, pass, dribble and shoot (play — col. 12, line 65 to col. 13, 
line 5). 

Claim 32, Jain discloses said object as a term and said state of said object 
comprises at least one of a team formation and ball possession (col. 33, lines 14-20; a 
football player represents a team). 

Claim 33, Jain discloses said desired output as comprising a numerical list 
having at least one numerical value for each flag indicating state of said object (col. 22, 
lines 27-37). 

7. Claims 8-1 1 and 35 are rejected under 35 U.S.C. 103(a) as being unpatentable by 
Katayama in view of Tamir et al. (5,923,365). 



Application/Control Number: 09/919,989 Page 10 

Art Unit: 2671 

Claim 8, Katayama discloses data processing means for generating an image 
data by image-picking up an image of a sports game (through a video camera; col. 6, 
lines 1-3), for processing said image data generated in accordance with a 
predetermined format (video, col. 6, lines 1-3); and for storing said data processed in 
said predetermined format (videocassette; col. 6, lines 1-3); interface means connected 
to said data processing means comprising an instruction entering means for entering a 
plurality of instructions (menu screen 1, FIG.3, and menu screen 11, FIG.11), said 
interface means receives said processed data in said predetermined format, converts 
the processed data into a predetermined form in accordance with an entered instruction, 
(statistics; see, for example, col. 6, lines 12-20); and outputs said converted data in 
accordance with said entered instruction; (FIG. 16 -the output of clicking on the score 
table L icon in FIG.1 1 ); and image displaying means connected to said interface means 
for displaying on a screen said outputted data from said interface means (monitor 
display A, FIG.1); and an instruction entering means which comprises a main instruction 
entering level for performing a plurality of different kinds of analyses (menu screen 11, 
FIG. 11). 

However, Katayama does not disclose a common instruction entering level to be 
utilized commonly for said plurality of different kinds of analyses. These elements are 
disclosed by the Tamir sports event video manipulating system (the use of light pen 60 
to enter instructions to mark objects of interest on a video, col. 7, lines 39-52). Therefore, 
it would have been obvious to one of ordinary skill in the art to have modified the 
Katayama apparatus in view of the Tamir system by installing the code that enables 
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video editing in Tamir in the Katayama personal computer. Such a modification to 
Katayama would enable the user to utilize a fast editing and analysis tool for half-time 
situations to allow the coaches to make strategy adjustment during halftime (Tamir, col. 
6, lines 18-20). 

Claim 9, Katayama discloses a common instruction entering level is configured 
to enter at least one related item with respect to a sports game subject to an analysis 
(pitching form of opposing pitcher, col. 6, lines 40-49). 

Claim 10, Kataynma discloses said main instruction entering level is configured 
to select an analysis of data or an analysis of formation regarding a sports game subject 
to an analysis, as one of said plurality of different kinds of analyses (col. 6, lines 12-20, 
especially lines 17-20 (keys Q, R, T)). 

Claim 11, Katayama discloses said related item comprising at least one of a 
player, a team, weather, a stadium of a game, a date of a game, a starting time of a 
game, and a number of spectators of a game (player; pitching form of opposing pitcher, 
col. 6, lines 40-49). 

Claim 35, Katayama discloses data processing means for generating an image 
data by image-picking up an image of a sports game (through a video camera; col. 6, 
lines 1-3), for processing said image data generated in accordance with a 
predetermined format (video, col. 6, lines 1-3)., and for storing said data processed in 
said predetermined format (videocassette; col. 6, lines 1-3); interface means connected 
to said data processing means comprising an instruction entering means for entering a 
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plurality of instructions (menu screen 1, F1G.3, and menu screen 11, FIG.11), said 
interface means inputs said processed data in said predetermined format, converts 
said input data into a predetermined form in accordance with an entered instruction, 
(statistics; see, for example, col. 6, lines 12-20); and outputs said converted data in 
accordance with said entered instruction; (FIG.16-the output of clicking on the score 
table L icon in FIG.1 1); and image displaying means connected to said interface 
means for displaying on a screen said outputted data from said interface means 
(monitor display A, F1 G.1 ); wherein said predetermined form comprises at least one of 
a chart a numerical list (the object labeled "batting order" in FIG.22 is both a chart and a 
numerical list, and the chart/list is produced by the instruction which executes when the 
R key is pressed (see col. 8, lines 29-31:, an image (produced by the instruction which 
executes when the user clicks on M and L; col. 6, lines 40-44) and a video (the 
instruction that produces, for example, FIG. 12; see also col. 4, lines 50-53), and an 
instruction entering means which comprises a main instruction entering level for 
performing a plurality of different kinds of analyses (menu screen 1 1 , FIG.1 1 ); 
.wherein said common instruction entering level is configured to enter at least one 
related item with respect to a sports game subject to an analysis (pitching form of 
opposing pitcher, col. 6, lines 40-49); wherein said related item comprises at least one 
of a player, a team, weather, a stadium of a game, a date of a game, a starting time of a 
game, and a number of spectators of a game (player: pitching form of opposing pitcher, 
col. 6, lines 40-49); wherein said interface means comprises functions of displaying all 
plays of an opponent teams at said sports game as a list in accordance with said play 
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list, and of retrieving a desirable play seen at said sports game by designating an 
optional item of said play list (FIG.1 6 displays all plays, and col. 6, lines 24-48 explains 
how a desirable play is retrieved). 

However, Katayama does not disclose a common instruction entering level to be 
utilized commonly for said plurality of different kinds of analyses. These elements are 
disclosed by the Tamir sports event video manipulating system (the use of light pen 60 
to enter instructions to mark objects of interest on a video, col. 7, lines 39-52). 
Therefore, it would have been obvious to one of ordinary skill in the art to have modified 
the Katayama apparatus in view of the Tamir system by installing the code that enables 
video editing in Tamir in the Katayama personal computer. Such a modification to 
Katayama would enable the user to utilize a fast editing and analysis tool for half-time 
situations to allow the coaches to make strategy adjustment during halftime (Tamir, col. 
6, lines 18-20). 

8. Claim 34 is rejected under 35 U.S.C. 1 03(a) as being unpatentable by Katayama 
in view of Jain. 

Claim 34, Katayama does not disclose said converted data displayed at an angle 
selected by a user. However, these elements are disclosed by Jain at col. 14, lines 55- 
58. Therefore, it would have been obvious to one of ordinary skill in the art to have 
modified the Katayama apparatus in view of the Jain system by installing the Jain scene 
analysis module in FIG.2 between the Katayama video camera J and the Katayama 
personal computer B (FIG.1). Such a modification to Katayama would award the viewer 
the best view of the object (Jain, col. 14, lines 59-61). 
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9. Claims 37 and 40 are rejected under 35 U.S.C. 103(a) as being unpatentable by 
Katayama in view of Rosser (6,750,91 ), and further in view of Tamir. 

Claims 37 and 40, Katayama discloses data processing means for generating an 
image data by image-picking up an image of a sports game (through a video camera; 
col. 6, lines 1-3), for processing said image data generated in accordance with a 
predetermined format (video, col. 6, lines 1-3); and for storing said data processed in 
said predetermined format (videocassette; col. 6, lines 1-3); interface means connected 
to said data processing means comprising an instruction entering means for entering a 
plurality of instructions (menu screen 1 , FIG.3, and menu screen 1 1 , FIG.1 1 ), said 
interface means receives the processed data in said predetermined format, converts 
The received data into a predetermined form in accordance with an entered instruction, 
(statistics; see, for example, col. 6, lines 12-20), and outputs said converted data in 
accordance with said entered instruction; (FIG.1 6-the output of clicking on the score 
table L icon in FIG.1 1); and image displaying means connected to said interface means 
for displaying on a screen said outputted data from said interface means (monitor 
display A, FIG.1); wherein said interface means is operable to convert said inputted 
data into each of a chart, a numerical list (the object labeled "batting order" in FIG. 22 is 
both a chart and a numerical list, and the chart/list is produced by the instruction which 
executes when the R key is pressed (see col. 8, lines 29-31), an image (produced by 
the instruction which executes when the user clicks on M and L; col. 6, lines 40-44) and 
a video (the instruction that produces, for example, FIG.1 2; see also col. 4, lines 50-53). 
wherein said interface means is configured to enable said image displaying means to 
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display a play list or a graph that is indicative of a desired analytical result in response 
to a kind of said instruction (FIG. 16, which concerns meetings between a certain batter 
and a certain pitcher). 

However, with respect to both claims, Katayama does not disclose said interface means 
capable of enabling said display means to display simultaneously an animation based 
on said data converted into said predetermined form in accordance with said play list, 
and an image of a sports game based on said image data corresponding to said 
animation. 

These elements are disclosed by the Rosser method of placing event related 
information into a video broadcast. The interface means is the live video insertion 
system 16, FIG. I. The display means is 28, FIG. I. The "animation based on said data 
converted into said predetermined form" is the scoreboard (col. 7, lines 58-59). It is 
played in accordance with said play list (Katayama, FIG. 16 and col. 6, lines 40-61), and 
an image of a sports game based on said image data corresponding to said animation 
is disclosed in both Katayama, FIG. 12, and Rosser col. 5, line 25. 
Therefore, it would have been obvious to one of ordinary skill in the art to have modified 
the Katayama apparatus in view of the Rosser system by installing the software in the 
Rosser live video insertion system unit 16, FIG.1 (see Rosser, col. 4, lines 10-14) into 
the Katayama personal computer B (F1G.1). 

Such a modification to Katayama would allow addition of event related information into a 
video so that the added information does not interfere with or obscure the primary action 
of interest in the video (Rosser, Abstract, first sentence). 
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Neither Katayama nor Rosser disclose editing a video of said sports game while 
analyzing data of said sports game. These elements are disclosed by Tamir (the use of 
light pen 60 to enter instructions to mark objects of interest on a video, col. 7, lines 39- 
52). 

Therefore, it would have been obvious to one of ordinary skill in the art to have 
modified the Katayama apparatus in view of the Tamir system by installing the code that 
enables video editing in Tamir in the Katayama personal computer. Such a modification 
to Katayama would enable the user to utilize a fast editing and analysis tool for half-time 
situations to allow the coaches to make strategy adjustment during halftime (Tamir, col. 
6, lines 18-20). 

Allowable Subject Matter 

10. Claim 42 is objected to as being dependent upon a rejected base claim, but 
would be allowable if rewritten in independent form including all of the limitations of the 
base claim and any intervening claims. 

The following is a statement of reasons for the indication of allowable subject matter: 
the prior art does not teach the time-series data processing devices perform numerical 
analysis of the sport team formation based on open spaces on a game field. 

Response to Arguments 

1 1 . Applicant's arguments filed 06/09/05 have been fully considered but they are not 
persuasive., because claim 1, Jain teaches display the data list and an animated image 
(fig. 4); claim 29 has been rejected (see the Office Action); Katayama teaches the 
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predetermined format is converted into numeric data through converter E for the 
plurality of different kinds of analysis (a numerical indicator of 0 to 9 for inputting a ball 
speed thrown by pitcher are provided; col. 4, lines 66-67), and wherein based on a kind 
of analysis, the converted data is displayed in a form of numeric list (col. 5, lines 49-57), 
a chart, a graph (col. 7, lines 10-22; fig. 17), an image, and a video (col. 6, lines 45-49). 
12. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Kimbinh T. Nguyen whose telephone number is (571) 
272-7644. The examiner can normally be reached on Monday to Thursday from 7:00 
AM to 4:30 PM. The examiner can also be reached on alternate Friday from 7:00 AM to 
3:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ulka Chauhan can be reached at (571) 272-7782. The fax phone number for 
the organization where this application or proceeding is assigned is (571) 273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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